The Minimax Distortion Redundancy In Empirical Quantizer Design - Information Theory, IEEE Transactions on

We obtain minimax lower and upper bounds for the expected distortion redundancy of empirically designed vector quantizers. We show that the mean-squared distortion of a vector quantizer designed from n independent and identically distributed (i.i.d.) data points using any design algorithm is at least (n ) away from the optimal distortion for some distribution on a bounded subset of R. Together with existing upper bounds this result shows that the minimax distortion redundancy for empirical quantizer design, as a function of the size of the training data, is asymptotically on the order of n . We also derive a new upper bound for the performance of the empirically optimal quantizer.